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IMAGE PROCESSING APPARATUS 
leld of Technology 



The present invention relates to an image processing technique 
5 that uses shooting information or information on specification of image 
processing to implement the image processing of image data. 



Backoround of the Invention 

Digital still cameras (DSC) having shooting modes corresponding 

10 to various shooting scenes, such as portrait and nightscape have been 
widely used. In response to selection of a shooting mode, the DSC is 
set to have preset values of multiple shooting parameters, such as 
shutter speed and exposure, corresponding to the selected shooting 
mode. The photographer is thus not required to individually set the 

15 shooting parameters and easily takes photographs of a subject under 
shooting conditions specified by the selected shooting mode. In the 
case of image data complying with a DSC file format standard Exit 2.2, 
the selected shooting mode is written, together with other shooting 
conditions including a shutter speed, an exposure mode, and a light 

20 source, in a header or an equivalent portion of the image data. 

The applicant of the invention has proposed a practical technique 
that sets image processing control information for specifying image 
processing conditions adopted in an image processing apparatus 
according to the shooting mode selected in the DSC, the shooting 

25 conditions, and the reproduction characteristics of an output device, and 
outputs the settings of the image processing control information related 
to image data. This technique ensures image processing suitable for 
the shooting mode selected by the photographer (that is, image 
processing reflecting the intention of the photographer). The image 

30 processing control information used in this technique is set by taking 
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into account the reproduction characteristics of the output device and is 
thus substantially different from the shooting information, which simply 
describes the shooting conditions. 

The shooting information Including the shooting mode Is, 
5 however, Included In a greater number of Image data (Image files), 
compared with the Image processing control information. When the 
image processing control information is not available, it is desirable to 
utilize the shooting information and thereby make a greater number of 
image data subjected to Image processing suitable for a shooting scene 
10 at the time of shooting (that is, a shooting mode selected by the 
photographer). 

SUMMARY OF THE INVENTION 
In order to solve the above problems of the prior art technique, 

15 the present invention aims to make a greater number of image data 

subjected to a series of Image processing suitable for a shooting scene 
at a time of shooting each of the image data. 

A first application of the Invention to attain the above object is 
directed to an Image processing method that makes Image data, which 

20 includes shooting information obtained at a time of shooting, subjected 
to a series of image processing suitable for a selected shooting scene. 
The image processing method in the first application of the invention 
acquires image data; retrieves scene-dependent image processing 
condition specification information, which is related to the acquired 

25 image data and is used to specify a scene-dependent image processing 
condition suitable for the selected shooting scene; specifies the 
selected shooting scene based on the shooting information, in the case 
of failed retrieval of the scene-dependent image processing condition 
specification information; acquires a scene-dependent image 

30 processing condition suitable for the specified shooting scene from a 
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memory device, which stores multiple scene-dependent image 
processing conditions set for multiple shooting scenes; and executes 
image quality adjustment of the image data with the acquired 
scene-dependent image processing condition. 
5 In accordance with the first application of the invention, even 

when the scene-dependent image processing condition specification 
information, which is used to specify the scene-dependent image 
processing condition suitable for the selected shooting scene, is not 
available, the image processing method in the first application of the 

10 invention utilizes the general shooting information given as attribute 
information of the image data to obtain the scene-dependent image 
processing condition suitable for the selected shooting scene and 
executes image quality adjustment with the obtained scene-dependent 
image processing condition. This arrangement desirably enables a 

15 greater number of image data to be subjected to the image processing 
suitable for the shooting scene at the time of shooting each of the image 
data. 

In the first application of the invention, in the case of successful 
retrieval of the scene-dependent image processing condition 

20 specification Information, the image processing method may acquire the 
scene-dependent image processing condition corresponding to the 
retrieved scene-dependent image processing condition specification 
information from the memory device. In this arrangement, the 
scene-dependent image processing condition may be is acquired, based 

25 on the scene-dependent image processing condition specification 
information representing the photographer's Intention at the time of 
shooting, thus ensuring execution of image quality adjustment reflecting 
the intention of the photographer. 

In another preferable arrangement of the first application of the 

30 Invention, when the shooting information includes preset information of 
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shooting scene, the innage processing method nnay specify the shooting 
scene, based on the preset information of shooting scene. In this 
arrangement, the preset information of shooting scene at the time of 
shooting is utilized to acquire the scene-dependent image processing 
5 condition, which reflects the shooting scene, and thereby ensures 

execution of image quality adjustment suitable for the shooting scene. 

In the image processing method according to the first application 
of the invention, one preferable procedure specifies the shooting scene, 
based on information on settings of exposure program, aperture, shutter 

10 speed, subject distance range, ISO speed rate, and flash included in the 
shooting information. These pieces of the shooting information may be 
used for estimation of the shooting scene. 

In the image processing method according to the first application 
of the invention, when the shooting information does not include the 

15 preset information of shooting scene, the shooting scene may be 
specified, based on information on settings of exposure program, 
aperture, shutter speed, subject distance range, ISO speed rate, and 
flash included in the shooting information. This arrangement ensures 
execution of image quality adjustment suitable for the shooting scene, 

20 even when the information of shooting scene is not available. 

In the image processing method according to the first application 
of the invention, the scene-dependent image processing condition may 
be a combination of values of multiple image quality-relating parameters, 
which are set in advance for each shooting scene. This arrangement 

25 ensures adaptation of image quality adjustment for the shooting scene 
with a high accuracy. 

The first application of the invention is also actualized by an 
image processing apparatus that makes image data, which includes 
shooting information obtained at a time of shooting, subjected to a 

30 series of image processing suitable for a selected shooting scene. The 
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image processing apparatus in the first application of the invention 
includes: an image data acquisition WHt module that acquires image 
data; a memory WHt module that stores multiple scene-dependent image 
processing conditions set for multiple shooting scenes; a 
5 scene-dependent image processing condition acquisition wnt module 
that, in the case of failed retrieval of scene-dependent image processing 
condition specification information, which is related to the acquired 
image data and is used to specify a scene-dependent image processing 
condition suitable for the selected shooting scene, specifies the 

10 selected shooting scene based on the shooting information and acquires 
a scene-dependent image processing condition suitable for the 
specified shooting scene from the memory wwt module : and an image 
quality adjustment WHt module that executes image quality adjustment 
of the image data with the acquired scene-dependent image processing 

15 condition. 

The image processing apparatus according to the first 
application of the invention has similar functions and effects to those of 
the image processing method in the first application of the invention and 
has various arrangements as discussed above with regard to the image 

20 processing method. 

The first application of the invention is further actualized by a 
computer program product storing a program that causes a computer to 
utilize multiple scene-dependent image processing conditions set for 
multiple shooting scenes and to make image data, which includes 

25 shooting information obtained at a time of shooting, subjected to a 

series of image processing suitable for a selected shooting scene. In 
the computer program product according to the first application of the 
invention, the program includes: a computer command that retrieves 
scene-dependent image processing condition specification information, 

30 which is related to acquired image data and is used to specify a 
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scene-dependent image processing condition suitable for the selected 
shooting scene; a computer command that specifies the selected 
shooting scene based on the shooting information, in the case of failed 
retrieval of the scene-dependent image processing condition 
5 specification information; a computer command that selects a 

scene-dependent image processing condition suitable for the specified 
shooting scene among the multiple scene-dependent image processing 
conditions; and a computer command that executes image quality 
adjustment of the image data with the selected scene-dependent image 

10 processing condition. 

The computer program product according to the first application 
of the invention has similar functions and effects to those of the image 
processing method in the first application of the invention and has 
various arrangements as discussed above with regard to the image 

15 processing method. 

A second application of the invention is directed to an image 
processing method that executes a series of image processing suitable 
for a shooting scene selected at a time of shooting. The image 
processing method in the second application of the invention acquires 

20 image data; retrieves Image processing control information, which 

specifies a scene-dependent image processing condition suitable for the 
selected shooting scene and is related to the acquired image data; in 
the case of successful retrieval of the image processing control 
information, acquired the scene-dependent image processing condition 

25 specified by the retrieved image processing control information from a 
memory device, which stores multiple scene-dependent image 
processing conditions as combinations of values of multiple image 
quality-relating parameters set in advance for multiple shooting scenes; 
and executes image quality adjustment of the image data with the 

30 acquired scene-dependent image processing condition. 
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The image processing method in the second application of the 
invention utilizes the image processing control information, which is 
used to specify the scene-dependent image processing condition 
suitable for the selected shooting scene, to acquire the 
5 scene-dependent image processing condition suitable for the shooting 
scene and executes image quality adjustment with the obtained 
scene-dependent image processing condition. This arrangement 
desirably enables the scene-dependent image processing condition, 
which represents the photographer's intention at the time of shooting, to 

10 be obtained adequately, thus ensuring execution of image quality 
adjustment reflecting the intention of the photographer. 

In one preferable arrangement of the second application of the 
invention, the image processing method determines the shooting scene 
selected at the time of shooting, based on the shooting information. In 

15 the case of failed retrieval of the image processing control information, 
the image processing method acquires out the scene-dependent image 
processing condition suitable for the definitely set shooting scene from 
the memory device. In such cases, the procedure of this arrangement 
utilizes the general shooting information given as attribute information 

20 of the image data to acquire the scene-dependent image processing 
condition suitable for the shooting scene. This desirably enables a 
greater number of image data to be subjected to image quality 
adjustment suitable for the shooting scene at the time of shooting each 
of the image data. 

25 The second application of the invention is also actualized by an 

image processing apparatus that executes a series of image processing 
suitable for a shooting scene selected at a time of shooting. The image 
processing apparatus in the second application of the invention 
includes: an image data acquisition wit module that acquires image 

30 data; a memory WKt module that stores multiple scene-dependent image 
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processing conditions as combinations of values of multiple image 
quality-relating parameters set in advance for multiple shooting scenes; 
a scene-dependent image processing condition acquisition w^t module 
that, in the case of successful retrieval of image processing control 
5 information, which specifies a scene-dependent image processing 

condition suitable for the selected shooting scene and is related to the 
acquired image data, acquires the scene-dependent image processing 
condition specified by the retrieved image processing control 
information from the memory W4t module : and an image quality 
10 adjustment wit module that executes image quality adjustment of the 
image data with the acquired scene-dependent image processing 
condition. 

The image processing apparatus according to the second 
application of the invention has similar functions and effects to those of 

15 the image processing method in the second application of the invention 
and has various arrangements as discussed above with regard to the 
image processing method. 

The second application of the invention is further actualized by a 
computer program product storing an image processing program that 

20 causes a computer to utilize multiple scene-dependent image 

processing conditions as combinations of values of multiple image 
quality-relating parameters set in advance for multiple shooting scenes 
and to execute a series of image processing suitable for a shooting 
scene selected at a time of shooting. In the computer program product 

25 according to the second application of the invention, the image 

processing program includes: a program command that retrieves image 
processing control information, which specifies a scene-dependent 
image processing condition suitable for the selected shooting scene and 
is related to acquired image data; a program command that, in the case 

30 of successful retrieval of the image processing control information, 
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selects the scene-dependent image processing condition specified by 
the retrieved image processing control information, among the multiple 
scene-dependent image processing conditions; and a program 
command that executes image quality adjustment of the image data with 
5 the selected scene-dependent image processing condition. 

The computer program product according to the second 
application of the invention has similar functions and effects to those of 
the image processing method in the second application of the invention 
and has various arrangements as discussed above with regard to the 

10 image processing method. 

A third application of the invention Is directed to an image 
processing method that makes image data, which includes shooting 
information obtained at a time of shooting, subjected to a series of 
image processing. The image processing method in the third 

15 application of the invention retrieves image processing control 

information, which is related to the image data and is used to specify an 
image processing condition; In the case of failed retrieval of the image 
processing control information, selects an image processing condition, 
which Is suitable for a shooting condition at the time of shooting, based 

20 on the shooting information from a memory device that stores multiple 
different image processing conditions set for the image data; and 
executes image quality adjustment of the image data with the selected 
image processing condition. 

In accordance with the third application of the invention, even 

25 when the image processing control information, which is used to specify 
the image processing condition, is not available, the Image processing 
method in the third application of the invention utilizes the general 
shooting information given as attribute information of the image data to 
acquire the image processing condition, which corresponds to the image 

30 data and is suitable for the shooting condition at the time of shooting. 
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and executes image quality adjustment with the obtained image 
processing condition. This arrangement desirably enables a greater 
number of image data to be subjected to the image processing suitable 
for the shooting condition at the time of shooting each of the image data. 
5 In one preferable arrangement of the third application of the 

invention, in the case of successful retrieval of the image processing 
control information, the image processing method selects an image 
processing condition specified by the retrieved image processing control 
information from the memory device. The procedure of this 

10 arrangement utilizes the image processing control information to 
acquire the image processing condition, thus ensuring execution of 
image quality adjustment reflecting the intention of the photographer. 

In another preferable arrangement of the third application of the 
invention, when the shooting information includes preset information of 

15 shooting scene at the time of shooting, the image processing method 
selects the image processing condition, based on the preset information 
of shooting scene. The procedure of this arrangement utilizes the 
preset information of shooting scene at the time of shooting to acquire 
the image processing condition, which reflects the shooting scene, and 

20 thereby ensures execution of image quality adjustment suitable for the 
shooting scene. 

In still another preferable arrangement of the third application of 
the invention, the image processing method selects the image 
processing condition, based on at least information on settings of 
25 exposure program, aperture, shutter speed, subject distance range, ISO 
speed rate, and flash included in the shooting information. These 
pieces of the shooting information may be used for estimation of the 
shooting scene. 

When the shooting information does not include the preset 
30 information of shooting scene at the time of shooting, the image 
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processing condition may be selected, based on at least information on 
settings of exposure program, aperture, shutter speed, subject distance 
range, ISO speed rate, and flash included in the shooting information. 
This arrangement ensures execution of image quality adjustment 
5 suitable for the shooting scene, even when the information of shooting 
scene is not available. 

In the image processing method according to the third 
application of the invention, the image processing condition may be a 
combination of values of multiple image quality-relating parameters, 

10 which are set in advance for each shooting scene. This arrangement 
ensures adaptation of image quality adjustment for the shooting scene 
with a high accuracy. 

The third application of the invention is also actualized by an 
image processing apparatus that makes image data, which includes 

15 shooting information obtained at a time of shooting, subjected to a 
series of image processing. The image processing apparatus in the 
third application of the invention includes: a memory wHt module that 
stores multiple different image processing conditions set for the image 
data; a selection w=Ht module that, in the case of failed retrieval of image 

20 processing control information that is related to the image data and is 
used to specify an image processing condition, selects an image 
processing condition, which is suitable for a shooting condition at the 
time of shooting, based on the shooting information from the memory 
WHt module : and an image quality adjustment WHt module that executes 

25 image quality adjustment of the image data with the selected image 
processing condition. 

The image processing apparatus according to the third 
application of the invention has similar functions and effects to those of 
the image processing method in the third application of the invention 

30 and has various arrangements as discussed above with regard to the 
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image processing method. 

The third application of the Invention Is further actualized by a 
computer program product storing an image processing program that 
causes a computer to make image data, which Includes shooting 
5 Information obtained at a time of shooting, subjected to a series of 
image processing. In the computer program product according to the 
third application of the invention, the image processing program 
includes: a program command that retrieves image processing control 
information that is related to the Image data and is used to specify an 

10 Image processing condition; a program command that, In the case of 
failed retrieval of the Image processing control Information, selects an 
Image processing condition, which is suitable for a shooting condition at 
the time of shooting, based on the shooting information among multiple 
different image processing conditions set in advance for the image data; 

15 and a program command that executes image quality adjustment of the 
image data with the selected image processing condition. 

The computer program product according to the third application 
of the invention has similar functions and effects to those of the image 
processing method In the third application of the invention and has 

20 various arrangements as discussed above with regard to the Image 
processing method, 

A fourth application of the invention is directed to an image 
processing method that executes image processing of Image data 
having shooting Information, which is obtained at a time of shooting and 

25 includes information on a selected shooting scene. The image 

processing method In the fourth application of the invention acquires 
image data; acquires a scene-dependent image processing condition 
suitable for the selected shooting scene from a memory device, which 
stores multiple scene-dependent image processing conditions as Image 

30 processing conditions suitable for respective shooting scenes; and 
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executes image quality adjustment of the image data with the acquired 
scene-dependent image processing condition. 

The image processing method in the fourth application of the 
invention obtains the scene-dependent image processing condition 
5 suitable for the selected shooting scene and executes image quality 
adjustment with the acquired scene-dependent image processing 
condition. This arrangement enables the image data to be subjected to 
image processing suitable for the shooting scene at the time of 
shooting. 

10 In one preferable arrangement of the fourth application of the 

invention, the image data is associated with scene-dependent image 
processing condition specification information, which is used to specify 
the scene-dependent image processing condition applied for image 
processing. The image processing method receives selection 

15 information that determines which of the selected shooting scene and 
the scene-dependent image processing scene condition is to be used to 
acquire the scene-dependent image processing condition, and acquires 
the scene-dependent image processing condition from the memory 
device, according to the received selection information. 

20 The procedure of this arrangement acquires the 

scene-dependent image processing condition, based on either the 
selected shooting scene or the scene-dependent image processing 
condition specification information, which is used to specify the 
scene-dependent image processing condition applied for image 

25 processing. This arrangement enables the image data to be subjected 
to image processing suitable for a desired shooting scene with desired 
information. 

In the fourth application of the invention, the memory device may 
store a first scene-dependent image processing condition corresponding 
30 to the shooting scene and a second scene-dependent image processing 
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condition corresponding to the scene-dependent image processing 
condition specification information. The image processing method may 
select either of the first scene-dependent image processing condition 
and the second scene-dependent image processing condition according 
5 to the received selection information, so as to acquire the 

scene-dependent Image processing condition. This arrangement 
enables the image data to be subjected to more adequate image 
processing for a desired shooting scene. 

The fourth application of the invention is also actualized by an 

10 image processing apparatus that executes image processing of image 
data having shooting information, which is obtained at a time of shooting 
and includes information on a selected shooting scene. The image 
processing apparatus in the fourth application of the invention includes: 
an image data acquisition WHt module that acquires image data; a 

15 memory wwt module that stores multiple scene-dependent image 
processing conditions as image processing conditions suitable for 
respective shooting scenes; and an image quality adjustment wh4 
module that acquires a scene-dependent image processing condition 
suitable for the selected shooting scene from the memory WHt module 

20 and executes image quality adjustment of the image data with the 
acquired scene-dependent image processing condition. 

The image processing apparatus according to the fourth 
application of the invention has similar functions and effects to those of 
the image processing method in the fourth application of the invention 

25 and has various arrangements as discussed above with regard to the 
image processing method. 

The fourth application of the invention is further actualized by a 
computer program product storing an image processing program that 
causes a computer to execute image processing of image data having 

30 shooting information, which is obtained at a time of shooting and 
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includes information on a selected shooting scene. In the computer 
program product according to the fourth application of the invention, the 
image processing program includes: a program code that acquires 
image data; a program code that acquires a scene-dependent image 
5 processing condition suitable for the selected shooting scene from a 
memory device, which stores multiple scene-dependent image 
processing conditions as image processing conditions suitable for 
respective shooting scenes; and a program code that executes image 
quality adjustment of the image data with the acquired scene-dependent 

10 image processing condition. 

The computer program product according to the fourth 
application of the invention has similar functions and effects to those of 
the image processing method in the fourth application of the invention 
and has various arrangements as discussed above with regard to the 

15 image processing method. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 shows an image processing system as one embodiment, to 
which an image processing apparatus of the invention is applied; 
20 Fig. 2 is a block diagram schematically illustrating the structure 

of a digital still camera that is usable for generating image files (image 
data); 

Fig. 3 shows selection of a shooting mode in the digital still 
camera; 

25 Fig. 4 is a block diagram schematically illustrating the structure 

of a color printer functioning as an image processing apparatus in the 
embodiment; 

Fig. 5 shows the file structure of an Exif image file; 
Fig. 6 shows the detailed internal structure of shooting condition 
30 tags in the Exif file format used in the embodiment; 
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Fig. 7 shows settings of multiple image quality-relating 
parameters, which are stored in an HDD 152 (or a ROM) of a personal 
computer PC and define options of an image processing mode GM 
specified by image processing control information Gt; 
5 Fig. 8 is a flowchart showing an image processing routine 

executed by an image processing apparatus (personal computer PC) in 
the embodiment; 

Fiig. 9 is a flowchart showing an image quality adjustment routine 
with the image processing control information Gl executed by the image 
10 processing apparatus (personal computer PC) in the embodiment; 

Fig. 10 is a flowchart showing an image quality adjustment 
routine with Exif information executed by the image processing 
apparatus (personal computer PC) in the embodiment; and 

Fig. 11 shows a table that maps the Exif information to the image 
15 processing mode GM. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The image processing apparatus of the invention is discussed 
below as a preferred embodiment with reference to the accompanied 
20 drawings. 

A. Construction of Image Processing System 

The construction of an image processing system including an 
image processing apparatus in one embodiment is discussed below with 
reference to Figs. 1 through 4. Fig. 1 shows an image processing 
25 system as one embodiment, to which an image processing apparatus of 
the invention is applied. Fig. 2 is a block diagram schematically 
illustrating the structure of a digital still camera that is usable for 
generating image files (image data). Fig. 3 shows selection of a 
shooting mode in the digital still camera. Fig. 4 is a block diagram 
30 schematically illustrating the structure of a color printer functioning as 
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an image processing apparatus in tlie embodiment. 

The image processing system includes a digital still camera 12 
functioning as an input device to generate an image file, a personal 
computer PC functioning as an image processing apparatus to execute 
5 image processing based on the image file generated by the digital still 
camera 12 and to output print image data, and a color printer 20 
functioning as an output device to output resulting images according to 
the print image data. The color printer 20 may have the image 
processing functions of the personal computer PC. In this case, the 

10 color printer 20 works as a stand-alone to implement image processing 
and output of resulting images. The output device is not restricted to 
the printer 20 but may be a monitor 14 like a CRT display or an LCD 
display or a projector. In the description below, the color printer 20 
connecting with the personal computer PC is used as the output device. 

15 The personal computer PC is a general-purpose computer and 

includes a CPU 150 that executes an image processing program of the 
invention, a RAM 151 that temporarily stores the results of operations by 
the CPU 150 and image data, and a hard disk drive (HDD) 152 that 
stores the image processing program. The personal computer PC also 

20 has a card slot 153 that receives a memory card MC inserted therein 
and an input output terminal 154 that connects with a connector cable 
linked with the digital still camera 12. 

The digital still camera 12 focuses light information on a digital 
device (for example, a CCD or an electron multiplier tube) to acquire an 

25 image, and has an optical circuit 121 including the CCD or the like to 
collect the light information, an image acquisition circuit 122 that 
controls the optical circuit 121 to acquire a digital image, an image 
processing circuit 123 that processes the acquired digital image, and a 
control circuit 124 that has a memory and controls the respective 

30 circuits, as shown in Fig. 2. The digital still camera 12 stores the 
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acquired images as digital data into a memory device, such as a 
memory card MC. The JPEG data format as an irreversible 
compression storage system and the TIFF data format as a reversible 
compression storage system are typically applied for storage of image 
5 data in the digital still camera 12. Other storage formats like the RAW 
data format, the GIF data format, and the BMP data format are also 
applicable for storage of image data. 

As shown in Fig. 3, the digital still camera 12 also has a 
selection/set button 126 and a liquid crystal display 127, which is used 

10 to preview each shot image and effectuate selection and setting through 
operations of the selection/set button 126. The selection/set button 
126 may be used to set a shooting mode, which specifies shooting 
conditions including a shutter speed, an exposure program, and an ISO 
speed rate, as well as values of multiple shooting parameters 

15 corresponding to each shooting scene, such as twilight scene, 
nightscape, or portrait. 

When the digital still camera 12 has the function of specifying a 
series of image processing to be executed by the image processing 
apparatus with image processing control information Gl, the 

20 selection/set button 126 may be used to set individual image processing 
control parameters, such as lightness, contrast, quantity of exposure 
correction (exposure correction value), and white balance, or to set an 
image processing mode (shooting mode), which specifies values of 
multiple image processing control parameters used in the image 

25 processing apparatus according to the shooting conditions. The 

selection/set button 126 may otherwise be used to set both the shooting 
mode and the image processing mode. 

The digital still camera 12 maps image processing control 
information Gl, which is used to specify image processing of image data 

30 executed by the image processing apparatus (the color printer 20 and 
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the personal computer PC), or Exit information, which represents 
shooting information at the time of shooting image data, to the image 
data and stores the mapping in the form of an image file GF into the 
memory card MC. When the user selects a shooting mode (shooting 
5 scene), for example, portrait, nightscape, or twilight scene, suitable for 
shooting conditions, the procedure maps the selected shooting mode as 
the Exif information to the image data or maps an image processing 
mode, which corresponds to the selected shooting mode and specifies 
values or levels of multiple image processing control parameters 

10 including contrast, saturation, and sharpness, to the image data and 
stores the mapping into the memory card MC. The multiple image 
processing control parameters may include individually settable 
parameters like the quantity of exposure correction and the white 
balance. The settings of shooting parameters applied for each 

15 shooting mode and image processing parameters are related to the 

shooting mode and are stored on the memory in the control circuit 124 of 
the digital still camera 12. 

The image file GF generated by the digital still camera 12 is 
transmitted to the color printer 20 via a connector cable CV and the 

20 computer PC or directly via the connector cable CV. The image file GF 
is otherwise transmitted to the color printer 20 by inserting the memory 
card MC, in which the image file GF has been stored by the digital still 
camera 12, into a memory card slot of the computer PC or by directly 
connecting the memory card MC with the printer 20, In the structure of 

25 the embodiment, the personal computer PC executes image processing 
of the image data with the image processing control information Gl and 
outputs the processed image data to the color printer 20. 

The color printer 20 shown in Fig. 4 is capable of outputting color 
images and is, for example, an ink jet printer that ejects four color inks, 

30 cyan (C), magenta (M), yellow (Y), and black (K), on a printing medium 
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to create a dot pattern and thereby form an image. Another example of 
the color printer 20 is an electrophotographic printer that transfers and 
fixes color toners on a printing medium to form an image. Other color 
inks, light cyan (LC), light magenta (LM), and dark yellow (DY) may also 
5 be used, in addition to the above four color inks. 

As illustrated, the color printer 20 has a mechanism that drives 
print heads IH1 through IH4 mounted on a carriage 30 to eject inks and 
create dots, a mechanism that activates a carriage motor 31 to 
reciprocate the carriage 30 along a shaft of a platen 32, a mechanism 

10 that activates a sheet feed motor 33 to feed a cut sheet of printing paper 
40, and a control circuit 50. The mechanism of reciprocating the 
carriage 30 along the shaft of the platen 32 has a sliding shaft 34 that 
holds the carriage 30 arranged in parallel with the shaft of the platen 32 
in a slidable manner and a pulley 36 that supports an endless belt 35 

15 spanned between the carriage motor 31 and the pulley 36. 

The control circuit 50 adequately controls the operations of the 
sheet feed motor 33. the carriage motor 31, and the print heads IH1 
through IH4 in response to a print command sent from the personal 
computer PC and outputs image data sent from the personal computer 

20 PC as an image on a printing medium. Ink cartridge INC1 and INC2 are 
attached to the carriage 30. The ink cartridge INC1 keeps black (K) ink, 
whereas the ink cartridge INC2 keeps the other inks, that is, the three 
color inks, cyan (C), magenta (M), and yellow (Y), Additional inks of 
light cyan (LC), light magenta (LM), and dark yellow (DY) may also be 

25 kept in the ink cartridge, as mentioned previously. 



B. Structure of Image file 

The image file GF of this embodiment may have, for example, a 
file structure in conformity with the Exit format (Exif file) that was 
30 specified as a standard of the image file format for digital still cameras 
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by Japan Electronics and Information Technology Industries Association 
(JEITA), a file structure in conformity with the JFIF format (JFIF file) that 
was specified as a standard for making JPEG data files compatible by 
three corporations, C-Cube Microsystems, Xing Technology, and Digital 
5 Origin (Radius), or a file structure in conformity with the TIFF format 
(TIFF file) that specifies parameters relating to image data in the form of 
tags. The Exif files are classified by the type of image data stored 
therein into JPEG-Exif files that store JPEG image data in an 
irreversible compressed form and TIFF-Exif files that store TIFF image 

10 data in a reversible compressed form. 

The general structure of an Exif image file as a JPEG data 
storage file used in this embodiment is discussed below with reference 
to Figs. 5 through 7. Fig. 5 shows the file structure of an Exif image file. 
Fig. 6 shows the detailed internal structure of shooting condition tags in 

15 the Exif file format used in the embodiment. Fig. 7 shows settings of 
multiple image quality-relating parameters, which are stored in the HDD 
152 (or the ROM) of the personal computer PC and define options of an 
image processing mode GM specified by the image processing control 
information Gl, The terminology 'file structure*, 'data structure', and 

20 'storage area' used in this embodiment represents the image of a file or 
data in the storage state in a storage device. 

The image file GF includes JPEG image data GD and application 
marker segments APP to store attribute information of the JPEG image 
data GD. The application marker segments APP (IFD) use tags for 

25 identifying respective pieces of information, and each piece of 

information may be expressed by its corresponding tag name. The 
application marker segments APP shown in Fig. 5 include tags (area) for 
storing the image processing control information Gl, tags (area) for 
storing the Exif information, and thumbnail image data. 

30 Settings of image quality-relating parameters applied for image 
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processing executed by the personal computer PC or the color printer 
20 are described in the image processing control information Gl. The 
image quality-relating parameters include, for example, YCbCr to RGB 
color conversion matrix elements and gamma correction values, 
5 contrast, saturation, sharpness, lightness, and color balance of the 
digital still camera 12. The image processing control information Gl 
also includes image processing mode specification information, which is 
used to specify an image processing mode GM corresponding to a 
shooting mode selected at the time of shooting. The image processing 

10 mode GM is defined by multiple image quality-relating parameters, for 
example, contrast and saturation, as shown in Fig. 7. Each of the 
image quality-relating parameters takes different values corresponding 
to different image processing modes GM (shooting modes). A number 
is allocated to each image processing mode GM. The image 

15 processing control information Gl specifies a number to identify each 
image processing mode GM. 

The Exif information includes tags for storing user information 
and tags for storing shooting conditions. The user information tags 
include a Makernote tag arbitrarily usable by the Exif file user (for 

20 example, the manufacturer of the DSC). The image processing control 
information Gl may be described in this Makernote tag. Settings of 
various parameters relating to shooting conditions including an 
exposure program and a shutter speed are described in the shooting 
condition tags as shown in Fig. 6. 

25 

C. Image Processing Executed by Personal Computer PC 

A series of image processing executed by the personal computer 
PC is discussed below with reference to Figs. 8 through 11 . Fig. 8 is a 
flowchart showing an image processing routine executed by the image 
30 processing apparatus (the personal computer PC) in the embodiment. 
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Fig. 9 is a flowchart showing an image quality adjustment routine with 
the image processing control information Gl executed by the image 
processing apparatus (the personal computer PC) in the embodiment. 
Fig. 10 is a flowchart showing an image quality adjustment routine with 
5 the Exif information executed by the image processing apparatus (the 
personal computer PC) in the embodiment. Fig. 11 shows a table that 
maps the Exif information to the image processing mode GM. 

The CPU 150 of the personal computer PC activates an image 
quality adjustment program, in response to insertion of the memory card 

10 MC into the card slot 153 or in response to connection of the connector 
cable CV linked with the digital still camera 12 to the input output 
terminal 154. The CPU 150 first reads an image file GF from the 
memory card MC according to the user's instruction and temporarily 
stores the read-out image file GF into the RAIVI 151 (step SI 00). 

15 The CPU 150 determines whether the image file GF includes the 

image processing control information Gl (step S1 10). When the image 
processing control information Gl is found (detected) in the image file 
GF (step S1 10: Yes), the CPU 150 acquires the image processing 
control information Gl (step SI 20) and executes a series of image 

20 processing (image quality adjustment) with the acquired image 
processing control information Gl (step SI 30). 

The series of image processing with the image processing 
control information Gl is described with reference to Fig. 9. The CPU 
150 extends the image data GD included in the read-out image file GF 

25 and sequentially carries out matrix algebra with a matrix S on the 
extended image data GD, gamma correction with gamma correction 
values specified by the acquired image processing control information 
Gl, and matrix algebra with a matrix N"^M including a matrix M, so as to 
implement color conversion of YCbCr into wRGB (step S200). 

30 The image file GF processed according to this flowchart stores 
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JPEG image data, which represent YCbCr data in a compressed form. 
RGB data are generally used for image processing executed by the 
personal computer PC and the printer. Extension (decoding) of the 
JPEG data and the color conversion of YCbCr data into RGB data are 
5 accordingly required. The matrix S is typically used for conversion of 
YCbCr data into RGB data in the JFIF format as is known in the art, and 
is thus not specifically described here. For linearization of the relation 
to XYZ values in the course of color conversion, the gamma correction is 
carried out with the gamma correction values specified by the image 
10 processing control information Gl to attain linearization of the image 
data GD. 

The procedure of this embodiment carries out RGB to wRGB 
color conversion with the matrix N"^M including the matrix M, which 
takes into account the color reproduction characteristics of the color 

15 printer 20, in addition to the general YCbCr to RGB color conversion 
with the matrix S. The matrix M has elements specified by the image 
processing control Information Gl, and is used to convert the color 
space from an RGB color space (target color space) that defines 
(specifies) RGB data after the matrix algebra with the matrix S Into an 

20 XYZ color space that is a device-dependent color space. When the 
RGB data after the matrix algebra with the matrix S have RGB values 
out of the color range of an sRGB color space, a wRGB color space at 
least partly having a wider color range than the sRGB color space is 
specified as the color space defining the RGB data after matrix algebra 

25 with the matrix S. This arrangement effectively prevents loss of the 
RGB values and leads to a subsequent wider wRGB color space 
(working color space). The matrix N is used to convert the color space 
from an RGB color space allowed by the color printer 20, for example, a 
wRGB color space, into an XYZ color space. The matrix N"^M is a 

30 composite matrix to attain color conversion from RGB to XYZ to wRGB. 
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The CPU 150 acquires the image processing mode GM specified 
by the image processing control information Gl (step S210) and 
executes image quality adjustment of the resulting RGB data obtained 
by the color conversion with a set of parameters specified by the 
5 acquired image processing mode GM (step S220). According to a 
concrete procedure, the CPU 150 carries out image quality adjustment 
with the settings of the image quality-relating parameters defined by one 
of the options 1 through 11 of the image processing modes GM shown in 
Fig. 7, which corresponds to the number specified by the image 

10 processing control information Gl. The procedure of image quality 
adjustment is explained in detail. The CPU 150 analyzes the image 
data GD in units of pixel and obtains values of various characteristic 
parameters representing the characteristics of the image data GD, for 
example, image statistics like a minimum luminance, a maximum 

15 luminance, and a representative lightness. The CPU 150 specifies 
correction values to cancel or at least reduce differences between 
reference values, which are preset for the respective characteristic 
parameters and are stored in the HDD 152, and the image statistics 
obtained by the analysis, and corrects the RGB values of the image data 

20 GD. The correction of the image data GD, for example, corrects a tone 
curve, which defines a relation between input and output, with the 
specified correction values and substitutes the image data GD as an 
input into the corrected tone curve. 

The parameter values specified by the image processing mode 

25 GM are used to change the degree of cancellation or the degree of 
reduction (the amount of correction) of the difference between the 
reference value and the image statistic, while being directly reflected on 
the amount of correction (the correction value). 

For example, when a number '2' is set as the image processing 

30 mode GM, the degrees of correction to the reference values are set as 
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slightly softer (slightly weaker) for contrast, slightly brighter (slightly 
stronger) for lightness, standard for color balance, slightly lower (slightly 
weaker) for saturation, and slightly weaker for sharpness. The flesh 
color Is set as the stored color, so that flesh color data (RGB values) 
5 stored in advance in the HDD 152 are used for the image processing. 
The noise reduction is set OFF. The image quality adjustment is 
carried out in the image processing mode corresponding to each 
shooting scene. When the selected shooting scene is twilight scene, 
for example, red color seepage is not removed. When the selected 

10 shooting scene Is nightscape, in another example, the image data is not 
corrected to be brighter by lightness correction. Namely this 
arrangement ensures execution of image quality adjustment reflecting 
the intention of the photographer. 

The image processing control information Gl may include 

15 individually settable, image quality-relating parameters, such as 
lightness and contrast, other than a set of image quality-relating 
parameters for specifying the image processing mode GM. Such 
individually settable parameters are not specifically described here. 
The CPU 150 carries out color conversion to convert the 

20 resulting image data (RGB data) after the image quality adjustment into 
CMYK data (step S230), and returns to the image processing routine 
shown in Fig. 8. This process converts the color system of the image 
data to the CMYK color system adopted by the color printer 20 for 
execution of printing. A concrete procedure refers to a lookup table, 

25 which maps the RGB color system to the CMYK color system and is 
stored in the HDD 152 (ROM). 

When the series of image processing discussed above is 
concluded and the program returns to the image processing routine 
shown in Fig. 8, the CPU 150 carries out a print output process of the 

30 resulting image data (step SI 40) and then exits from this processing 
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routine. In the print output process, the CPU 150 successively 
executes a halftoning process and a resolution conversion process and 
transmits the processed data as raster data to the control circuit 50 of 
the color printer 20. 
5 When the innage processing control information Gl is not 

detected in the image file GF (step S1 10: No), the CPU 150 determines 
whether the Exif information is detected in the image file GF (step SI 50). 
When the Exif information is not retrieved in the image file GF (step 
SI 50: No), the CPU 150 carries out a series of standard image 

10 processing with preset image processing conditions, which do not 
depend upon the selected shooting mode (step SI 80), outputs the 
processed image data (step SI 40), and exits from this processing 
routine. The standard image processing may execute image quality 
adjustment with reference values. 

15 When the Exif information is retrieved in the image file GF (step 

S150: Yes), on the other hand, the CPU 150 acquires the Exif 
information (step S160) and carries out a series of image processing 
(image quality adjustment) with the acquired Exif information (step 
S170). 

20 The series of image processing with the Exif information is 

discussed below with reference to Fig. 10. The CPU 150 extends the 
image data GD included in the read-out image file GF and carries out 
matrix algebra with the matrix S on the extended image data GD, so as 
to attain YCbCr to RGB color conversion (step S300). The CPU 150 

25 subsequently determines whether a selected shooting mode, for 

example, portrait, twilight scene, or nightscape, is described in the Exif 
information (step S310). 

When the shooting mode is detected in the Exif information (step 
S310: Yes), the CPU 150 selects and acquires the image processing 

30 mode GM corresponding to the shooting mode described in the Exif 
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information (step S320) and executes image quality adjustment in the 
acquired image processing mode GM (step S330). In general, the 
number of shooting modes described as the Exif information is less than 
the number of image processing modes GM. No problem accordingly 
5 arises in the mapping of the Exif information to the image processing 
mode GM. When the number of shooting modes described as the Exif 
information exceeds the number of image processing modes GM, the 
number of image processing modes GM is simply to be increased. The 
image quality adjustment in the image processing mode GM follows the 

10 procedure of image processing with the image processing control 
information Gl discussed above. 

When the shooting mode is not detected in the Exif information 
(step S310: No), on the other hand, the CPU 150 selects and acquires 
the image processing mode GM based on other shooting conditions 

15 described in the Exif information (step S340) and executes image 
quality adjustment in the acquired image processing mode GM (step 
S330). A table shown in Fig. 11 is, for example, applicable for the 
mapping of the shooting conditions to the image processing mode GM. 
The shooting conditions used in this embodiment are a combination of 

20 an exposure program for setting the priority to either of the shooting 
parameters, the exposure or the shutter speed, an aperture value (F 
number) representing the setting of light exposure to the CCD, a shutter 
speed representing the setting of an exposure time to the CCD, a 
subject distance range, an ISO speed rate representing the sensitizing 

25 quantity, and a flash operating state like prohibited emission or forcible 
emission. These shooting conditions are only illustrative and not 
restrictive in any sense. Other shooting conditions including white 
balance, gain control, contrast, saturation, and sharpness of shooting, a 
digital zoom magnification, an exposure time, a light source, and a 

30 subject area may adequately be added to the above combination or 
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used in different combinations. 

The CPU 150 carries out color conversion to convert the 
resulting image data (RGB data) after the image quality adjustment into 
CMYK data (step S350), and returns to the image processing routine 
5 shown in Fig. 8. This process converts the color system of the image 
data to the CMYK color system adopted by the color printer 20 for 
execution of printing. A concrete procedure refers to a lookup table, 
which maps the RGB color system to the CMYK color system and is 
stored in the HDD 152 (ROM). 

10 When the series of image processing discussed above is 

concluded and the program returns to the image processing routine 
shown in Fig. 8, the CPU 150 carries out the print output process of the 
resulting image data (step S140) and then exits from this processing 
routine. In the print output process, the CPU 150 successively 

15 executes a halftoning process and a resolution conversion process and 
transmits the processed data as raster data to the control circuit 50 of 
the color printer 20. 

As described above, when the image processing control 
information Gl includes the information for specifying the image 

20 processing mode GM, the personal computer PC functioning as the 
image processing apparatus of the embodiment executes image 
processing (image quality adjustment) in the image processing mode 
GM selected according to the mode-specifying information. This 
arrangement ensures execution of image quality adjustment 

25 corresponding to the shooting mode selected at the time of shooting, 
that is, image processing to give the photographer's desired output 
image. 

When the information for specifying the image processing mode 
GM is not included in the image processing control information Gl, the 
30 procedure executes image quality adjustment in the selected image 
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processing mode GM corresponding to the shooting mode described as 
the Exif information. This arrangement ensures execution of image 
quality adjustment corresponding to the shooting mode selected at the 
time of shooting, that is, image processing that reflects the intention of 
5 the photographer. 

When the shooting mode is not described as the Exif information, 
the procedure uses the Exif information other than the shooting mode to 
select the image processing mode GM corresponding to the shooting 
mode at the time of shooting and executes image quality adjustment in 

10 the selected image processing mode GM. As long as the Exif 

information is included in the image file GF, this arrangement ensures 
execution of image processing corresponding to the shooting scene at 
the time of shooting, that is, the image quality adjustment reflecting the 
photographer's intention. 

15 The personal computer PC functioning as the image processing 

apparatus of the embodiment selectively executes an adequate series of 
image processing among the three options discussed above according 
to the image file GF. This arrangement ensures execution of the most 
adequate image quality adjustment well reflecting the photographer's 

20 Intention and enables a greater number of image files GF to be 
subjected to the desired image quality adjustment. 

The procedure of the above embodiment utilizes either the 
information for specifying the image processing mode GM or the 
shooting mode described as the Exif information to specify the image 

25 processing mode GM, based on whether the information for specifying 
the image processing mode GM is included in the image processing 
control information Gl. One possible modification may utilize either the 
information for specifying the image processing mode GM or the 
shooting mode described as the Exif information to specify the image 

30 processing mode GM, in response to the user's selection. This 
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modified arrangement ensures execution of image processing that 
adequately reflects the user's intention. 

The procedure of the above embodiment adopts the image 
processing mode GM corresponding to the image processing control 
5 information Gl. One possible modification provides an image 

processing mode GM' corresponding to the shooting mode, in addition to 
the image processing mode GM corresponding to the image processing 
control information Gl, and executes image processing, in response to 
the user's selection, either in the image processing mode GM 
10 corresponding to the information for specifying the image processing 
mode GM or in the image processing mode GM' corresponding to the 
shooting mode described as the Exif information. This arrangement 
ensures execution of adequate image processing that well reflects the 
user's intention. 

15 When the image processing control information Gl does not 

include the information for specifying the image processing mode GM, 
the procedure executes image quality adjustment in the image 
processing mode GM, which is selected corresponding to the shooting 
mode described as the Exif information. This arrangement ensures 

20 image quality adjustment corresponding to the selected shooting mode, 
that is, image processing that well reflects the photographer's intention. 

In the structure of the above embodiment, the personal computer 
PC functioning as the image processing apparatus executes the whole 
series of image processing and outputs the processed image data to the 

25 color printer 20. In one modified structure, the color printer 20 may 

execute, without the assistant of the personal computer PC, all or part of 
the image processing and create a dot pattern according to the 
processed image data GD on a printing medium. The computer may 
assist the execution. In such modification, the color printer 20 has the 

30 Image processing functions discussed above with reference to Figs. 8 
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through 11. The image file GF generated by the digital still camera 12 
is directly transmitted to the color printer 20 via the cable or via the 
memory card MC. The image processing program is automatically 
activated in response to detection of insertion of the memory card MC or 
5 in response to detection of attachment of the cable, to automatically 
perform input of the image file GF, retrieval of the image processing 
control information Gl and the Exif information, conversion of the image 
data GD, and image quality adjustment. Another possible modification 
provides an auto image quality adjustment button on the operation panel 

10 of the color printer 20. The auto image quality adjustment process 

discussed in the above embodiment may be executed only in the case of 
selection of an auto image quality adjustment mode through the 
operation of the auto image quality adjustment button. 

In the structure of the above embodiment, the color printer 20 is 

15 used as the output device. The output device may be a display device, 
such as a CRT, an LCD, or a projector. In such cases, the display 
device functioning as the output device executes an image processing 
program (display driver) to implement the image processing described 
above with reference to Figs. 8 through 11. When the CRT or the like 

20 functions as a display device of the computer, the computer executes 
the image processing program. Here the eventually output image data 
has the RGB color space, instead of the CMYK color space. 

The resulting display on the display device, such as the CRT, 
reflects the image processing control information Gl, as the resulting 

25 print by the color printer 20 reflects the information obtained at the time 
of generating the image data. This arrangement ensures accurate 
display of the image data GD generated by the digital still camera 12. 

The embodiment regards the image file complying with the Exif 
file format as a concrete example of the image file GF. The image 

30 processing apparatus of the invention is, however, not restricted to 
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processing of the image files of this format, but is also applicable to 
processing of the image files GF complying with the JFIF file format and 
those complying with the TIFF file format. The image file processible 
by the image processing apparatus of the invention is required to 
5 include the image data GD and at least either of the image processing 
control information Gl and the Exif information related to the image data 
GD. 

In the embodiment discussed above,, the personal computer PC 
and the color printer 20 are only illustrative and are not restricted to the 

10 structure discussed above. The personal computer PC and the color 
printer 20 are required to have at least the functions of retrieving the 
image processing control information Gl or the Exif information in the 
image file GF, which may store both of the image processing control 
information Gl and the Exif information, selecting the image processing 

15 mode GM based on the retrieved information, carrying out auto image 
quality adjustment in the selected image processing mode GM, and 
outputting (printing) the processed image. 

In the structure of the above embodiment, the image data GD 
and the image processing control information Gl are included in the 

20 identical image file GF. The image data GD and the image processing 
control information Gl may not be stored in an identical file. The 
requirement is that the image data GD is related to the image 
processing control information Gl. One possible modification 
generates mapping data to relate the image data GD to the image 

25 processing control information Gl, stores one or multiple image data GD 
and the image processing control information Gl in separate files, and 
refers to the image processing control information Gl related to the 
image data GD at the time of processing the image data GD. In this 
modified structure, the image data is inseparably integrated with the 

30 image processing control information Gl in the course of image 
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processing with the image processing control information Gl. This 
gives the substantially equivalent functions to those attained by storage 
in the identical file. The technique is also applicable to video files 
stored in optical disk media, such as CD-ROMs. CD-Rs, DVD-ROMs, 
and DVD-RAMs. 

The Image processing apparatus and the image processing 
method of the invention are described above with reference to some 
embodiments. These embodiments are to be considered in all aspects 
as illustrative and not restrictive. There may be many modifications, 
changes, and alterations without departing from the scope or spirit of 
the main characteristics of the present invention. All changes within 
the meaning and range of equivalency of the claims are therefore 
Intended to be embraced therein. 
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